Systems, methods, and computer program products for automated real-time execution of live inserts of repurposed stored content distribution

ABSTRACT

A production system having a first production path, a second production path, and a control system that causes the first production path to generate a show in a first aspect ratio and the second production path to generate the same show in a second aspect ratio. Moreover, the product system can product a show from live material and from archived material. This aspect operates by producing a first show including multiple stories, segmenting the first show, and storing the show segments in an archive. Then, the system produces a second show using live portions as well as show segments retrieved from the archive. The product system can include a media manager that interacts with a server that may be integrated with the production system. The media manager automatically assigns channels/ports of the server when accessing material stored in the server.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims the benefit of U.S.patent application Ser. No. 16/105,358, filed Aug. 20, 2018, which is acontinuation of U.S. patent application Ser. No. 14/986,435 (now U.S.Pat. No. 10,056,111), filed Dec. 31, 2015, which is a continuation ofU.S. patent application Ser. No. 14/542,229 (now U.S. Pat. No.9,711,180), filed Nov. 14, 2014, which is a divisional of Ser. No.10/434,461 (now U.S. Pat. No. 9,123,380), filed May 9, 2003, whichclaims the benefit of U.S. Provisional Application Ser. No. 60/378,657entitled “Automated Real-Time Execution of Live Inserts of RepurposedStored Content Distribution” and filed May 9, 2002, and U.S. ProvisionalApplication Ser. No. 60/378,672 entitled “Multiple Aspect RatioAutomated Simulcast Production” and filed May 9, 2002, the entirecontents of each of which is herein incorporated by reference in theirentireties.

The following patents and patent applications of common assignee arerelated to the present application, and are herein incorporated byreference in their entireties:

“Real Time Video Production System and Method,” Ser. No. 09/215,161,filed Dec. 18, 1998, now U.S. Pat. No. 6,452,612, issued Sep. 17, 2002.

“System and Method for Real Time Video Production and Multicasting,”Ser. No. 09/634,735, filed Aug. 8, 2000.

“Method, System and Computer Program Product for Full News Integrationand Automation in a Real Time Video Production Environment,” Ser. No.09/822,855, filed Apr. 2, 2001.

“Method, System and Computer Program Product for Producing andDistributing Enhanced Media Downstreams,” Ser. No. 09/836,239, filedApr. 18, 2001.

“Advertisement Management Method, System, and Computer Program Product,”Ser. No. 10/247,783, filed Sep. 20, 2002.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates generally to production of live andas-live shows, and more particularly relates to production of live andas-live shows using live segments and re-purposed archived materials.

Related Art

The demand for 24-hour news programming is high, and growing steadily.Conventional systems and methods of producing news shows are laborextensive and, thus, expensive. What is needed are improved automatedsystems and methods for providing news programming that is less laborintensive and less expensive.

SUMMARY OF THE INVENTION

Briefly stated, the present invention is directed to a system, method,and computer program product for producing a show. In an embodiment, theinvention is directed to a production system having a first productionpath, a second production path, and a control system that causes thefirst production path to generate a show in a first aspect ratio (4:3),and that causes the second production path to generate the same show ina second aspect ratio (16:9).

In another embodiment, the invention is directed to producing a showfrom live material and from archived material. This aspect of theinvention operates by producing a first show comprising a plurality ofstories, segmenting the first show, and storing the show segments in anarchive. Then, the invention produces a second show using live portionsas well as show segments retrieved from the archive.

The invention is also directed to a media manager that interacts with aserver. In some cases, the server is integrated with the productionsystem. The media manager automatically assigns channels/ports of theserver when accessing material stored in the server.

Further features and advantages of the invention, as well as thestructure and operation of various embodiments of the invention, aredescribed in detail below with reference to the accompanying drawings.In the drawings, like reference numbers generally indicate identical,functionally similar, and/or structurally similar elements. The drawingin which an element first appears is generally indicated by theleft-most digit(s) in the corresponding reference number.

BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES

The invention shall be described with reference to the accompanyingfigures, wherein:

FIG. 1 is an example production system useful for simultaneouslygenerating outputs in native 4:3 format and native 16:9 format.

FIGS. 2 and 3 are example flowcharts depicting the operation of theinvention when producing shows using live content and re-purposedarchived materials.

FIG. 4 is an example production system for producing shows using livecontent and re-purposed archived materials.

FIG. 5 is an example user interface for the production system of FIG. 4.

FIG. 6 is a block diagram of a media manager according to an embodimentof the invention.

DETAILED DESCRIPTION OF THE INVENTION

Multiple Aspect Ratio Automated Simulcast Production

The invention is directed to a method, system, and computer programproduct for simulcasting digital video through outputs having differingformat requirements. As described in greater detail below, in anembodiment, the present invention allows broadcasters to automate andproduce a simulcast of dual 4:3 and 16:9 aspect ratio “live” or“as-live” programming. The present invention allows automaticadjustments to be made to character generators, still stores, transitioneffects, etc., such that the production can be synchronized andtransmitted over parallel mediums with non-substantial delay.

Overview

The market for digital television continues to evolve as broadcasterstransition from transmitting an analog NTSC signal to digital signals asmandated by the Federal Communications Commission (FCC). The massmajority of the installed television sets in the United States todayhave a 4:3 aspect ratio. New digital sets will come with the wider 16:9aspect ratio similar to the format used in motion pictures

Market analysts expect the installed base of digital television sets tobe at 4.2 million by the end of 2002. In addition, digital settop boxesthat receive the broadcast digital signal either over-the-air or throughcable for conversion onto existing analog television sets are expectedto have an installed base of 39.5 million. Television households by theend of 2002 are forecasted to be at 104.5 million. This shows a marketpenetration of 4% for digital television sets (16:9) and 38% for digitalsettop boxes (4:3). By the year 2005, the market penetration numberswill change for digital television sets from 4% to 17% while digitalsettop boxes change from 38% to 77%. This means that consumers will gothrough a period whereby many will be looking for a 16:9 format signalfrom broadcasters versus the standard 4:3 format currently used withanalog television sets.

The broadcaster will be challenged to deliver several different types ofprogramming solutions as follows:

4:3 original (“native”) output “letter boxed” to fit a 16:9 digitaltelevision set. The letter box could be “black” or contain text, data orgraphic content.

16:9 original (“native”) output sent out “as is” for display on 16:9digital television sets.

16:9 original (“native”) output “cropped” to fit into a 4:3 analogtelevision set with digital settop box converter.

In several of the cases above, compromises exist in order to serve theconsumer during the market transition from a 4:3 to a 16:9 aspect ratioformat. For example, some televisions include circuitry to convert fromone format to another. However, such conversions introduce artifacts andnegative impact resolution and/or the viewing experience. It ispreferable that televisions receive and use signals in their original,or native, formats.

Therefore, a need exists to automate the process of producingsimultaneous 4:3 and 16:9 formats from a single user interface to avoidduplicating both equipment and personnel resources. The simultaneousnative output of both formats allow the broadcaster to design a “lookand feel” that better enables them to take advantage of both 4:3 and16:9 aspect ratios without negatively impacting one over the other.

The invention is applicable to formats other than 4:3 and 16:9, and isalso applicable to the processing of greater than two formats, as willbe appreciated by persons skilled in the relevant arts based on theteachings contained herein.

Detailed Description

The invention allows broadcasters to automate and produce the simulcastof dual 4:3 and 16:9 aspect ratio “live” and “as-live” programming. FIG.1 is a block diagram of a production system 102 according to anembodiment of the invention. The production system 102 includes a userinterface 106, to enable interaction with users 104. Through the userinterface 106, users 104 can design and produce shows, such as but notlimited to live and as-live shows.

The production system 102 includes a control system 108, which controlsthe production system 102 (and components thereof) in the mannerdescribed herein. The control system 108 is implemented using a computeroperating according to software. Such software, when stored on acomputer readable medium (such as a CD, tape, hard drive, signalstraveling over a wired or wireless medium, etc.), is referred to ascomputer program product. The invention is directed to such computerprogram products, as well as methods embodied in such computer programproducts, and systems incorporating such computer program products.Alternatively, the control system 108 is implemented using predominatelyhardware (such as hardware state machines or application specificprocessors).

The production system 102 includes a number of production paths 110. Inthe example shown in FIG. 1, such production paths 110 include a 4:3production path 110A and a 16:9 production path 110B. These examples areprovided for illustrative purposes only, and are not limiting. Theinvention is applicable to other formats. Also, the invention canaccommodate more than two production paths.

The production system 102 also includes a number of sources 114, whichmay be cameras, tape machines, still stores, etc. The sources 114provide material for the show to the production paths 110, eitherdirectly or via the control system 108.

In operation, the control system 108 controls the 4:3 production path110A to generate a show in a native 4:3 format, to thereby generate anative 4:3 output 112A. Also, the control system 108 controls the 16:9production path 110B to generate a show in a native 16:9 format, tothereby generate a native 16:9 output 112B. In an embodiment, thecontrol system 108 simultaneously controls the 4:3 production path 110Aand the 16:9 production path 110B such that the native 4:3 output 112Aand the native 16:9 output 112B are synchronized with each other. Inpractice, the outputs 112A, 112B may not be precisely synchronized witheach other, but are sufficiently synchronized so that any offset fromeach other is not easily discernable by viewers (or are at least are notsufficiently distracting to viewers).

In an embodiment, the production system 102 is similar to that describedin “Real Time Video Production System and Method,” Ser. No. 09/215,161,filed Dec. 18, 1998, now U.S. Pat. No. 6,452,612, issued Sep. 17, 2002,referenced above (although the invention can be implemented using anyproduction system having the functionality described herein). However,the production system 102 is modified to include multiple productionpaths 110, and the control system 108 is modified to control themultiple production paths 110. Further information regarding theproduction system 102 is provided below.

Transition Macros for Controlling Multiple Production Paths

The invention uses a Transition Macro to achieve the functionalitydescribed herein. A transition macro is a set of video productioncommands, where each video production command is transmitted from aprocessing unit to a video production device. A user designs aproduction by combining one or more transition macros in a script.Execution of the transition macros cause the production system 102 toproduce the show in accordance with the script.

Transition macros are described in great detail in U.S. Pat. No.6,452,612, “Real Time Video Production System and Method,” referencedabove.

The '612 patent describes transition macros as controlling elements in asingle production path. In the present invention, transition macroscontrol elements in multiple production paths 110. For example, in theexample of FIG. 1, a given transition macro controls elements in boththe 4:3 production path 110A and the 16:9 production path 110B (althoughsome transition macros may still be limited to a subset of theproduction paths 110). This feature of the invention is furtherdescribed below.

Material for Multiple Formats

In an embodiment, the production system 102 includes material in thenative formats for each of the system 102's production paths 110. Forexample, for a given still, the production system 102 includes a 4:3version of the still, and a 16:9 version of the still. The productionpaths 110A, 110B may each include a dedicated still store, or may sharea still store. Another example relates to cameras. In an embodiment, the4:3 production path 110A includes 4:3 format cameras, and the 16:9production path 110B includes 16:9 format cameras. Such duplicity isgenerally (but not always) the case for the production paths 110, toenable generation of the outputs 112 in the multiple native formats.

For example, consider the case of mixed effect (ME) banks. Inembodiments of the invention, the production system 102 includes MEbanks dedicated for the 4:3 production path 110A, and other ME banksdedicated for the 16:9 production path 110B.

A number of methods for acquiring materials for the production (in thedifferent formats) are used, depending on a number of factors such ascost, availability, material types, as well as other implementationdependent factors. For example, in an embodiment, field acquisitionswill originally be in 16:9 format, since that format will capture moredata (when compared to 4:3). The 16:9 raw footage will then be used tocreate 4:3 format material (via appropriate cropping, for example). Theresult will be two separate files, one in 16:9 format, and one in 4:3format. Since both files were created prior to production, it ispossible to optimize both for their respective uses (i.e., one forproducing a 4:3 output, and one for producing a 16:9 output). In anotherembodiment, field acquisitions are obtained in multiple originalformats.

Such operation of the invention is in contrast to many conventionalpost-production conversion techniques, which try to convert a 16:9signal to a 4:3 signal (or vice versa). Since such cropping is performedpost-production, the cropping is not specifically tailored to thecharacteristics and parameters of the target format.

Processing Applicable Format

As noted above, the production paths 110 include components that arededicated to their operation. In practice, each production path 110 mayinclude a dedicated component, or they may share a single component. Forexample, in some embodiments, the production paths 110 may each includecharacter generator (CG) and still store components, or they may sharethe same character generator (CG) and still store components.

In an embodiment, all files are identified as being in either 4:3 formator 16:9 format (for example, each file may include meta data thatdenotes the applicable format). When the 4:3 production path 110Aaccesses material, it ensures that it accesses files tagged as being inthe 4:3 format. Similarly, when the 16:9 production path 110B accessesmaterial, it ensures that it accesses files tagged as being in the 16:9format. In embodiments, such control is achieved through operation ofthe control system 108, and/or through appropriate coding of transitionmacros.

Keyer Functionality

In an embodiment, the control system 108 includes a keyer for the 4:3production path 110A, and a second keyer for the 16:9 production path110B.

As will be appreciated, the output signals 112 comprise a composite ofsignals from multiple sources. For example, the output signals 112 maycomprise a first video signal having a hole, or “key,” cut therein. Asecond video signal is then inserted inside the key. The output signals112 are thus a composite of the first video signal and the second videosignal.

In the invention, the production system 102 includes video switchers toimplement keying. The video switchers switch between multiple videosources (i.e., the first and second video signals from the aboveexample). The switching operation of the video switchers is controlledby the control system 108, which is operating according tocommands/instructions contained in transition macros.

A given transition macro includes commands for both the 4:3 format andthe 16:9 format. For example, assume the user 104 inserts into a scriptthe icon for a particular transition macro relating to keying. In anembodiment, the user 104 need pay no concern to whether the icon relatesto the 4:3 format or the 16:9 format. Instead, the icon is associatedwith a transition macro that includes video commands to perform thekeying function for both the 4:3 format and the 16:9 format, such thatthe outputs 112 are synchronized. In other words, the invention providesa user interface 106 that shields the user 104 from the complexities ofthe generation of dual outputs 112A, 112B in dual formats.

Adjustment of Effects

The control system 108 independently adjusts effects (such as DVEtransitions like cuts, fades, wipes, etc.) for the desired look in aparticular format (i.e., 4:3 or 16:9). This is achieved throughtransition macros. Specifically, a particular “cut” transition macroincludes commands to effect the cut effect for the 4:3 format, andincludes other commands to effect the cut effect for the 16:9 format.Such commands access either 4:3 format source materials, or 16:9 sourcematerials, depending on whether the commands are for the 4:3 format orthe 16:9 format. Such commands also have appropriate duration settingsso the native 4:3 output 112A is synchronized with the native 16:9output 112B.

Source Management

The invention achieves source management for to simultaneously generatethe 4:3 output 112A and the 16:9 output 112B. The invention synchronizesand manages dual output control of video server ports for properingestion and processing in the system. The invention performs automatedformat detection to properly address source material that does not meetone or the other format. Therefore, the invention utilizes a number ofprocesses to “letterbox” a 4:3 format or “crop” a 16:9 format for properdisplay.

In other words, the control system 108 must ensure that source materialsare served to the 4:3 production path 110A and the 16:9 production path110B such that the 4:3 output 112A is synchronized with the 16:9 output112B. In one embodiment, the control system 108 issues control signalsto simultaneously activate servers in the two production paths 110A,110B. In this embodiment, the production paths 110A, 110B each havededicated servers. In another embodiment, the production paths 110A,110B share servers. In this embodiment, the control system 108communicates with a shared server(s) to server materials to theproduction paths 110A, 110B in a synchronous manner.

Exact synchronization between the outputs 112 is not necessary. The goalof the invention is to align the outputs 112 with one another sodifferences are not easily discernable to the human eye.

The invention also performs automated format detection to properlyaddress source material that does not meet one or the other format. Forexample, suppose in a show a particular source was available only in 4:3format. In order to use this source in both the 4:3 production path 110Aand the 16:9 production path 110B, the source would have to be convertedto the 16:9 format. Accordingly, the invention automatically determineswhether a given source is only available in certain formats (or,equivalently, whether a given source is not available in any formats ofinterest). The invention then automatically converts the source to theother formats, using any well known technique. Such conversion can beperformed either pre-production, or during production.

Addressing Camera Sources

The invention addresses camera sources properly according to therespective formats (4:3 or 16:9).

In some embodiments, both 4:3 cameras and 16:9 cameras are utilized toproduce the native 4:3 output 112A and the native 16:9 output 112B.

In other embodiments, only cameras of a single format are used, such as16:9 cameras. The video output of such cameras are then adjusted(cropped) to form the 4:3 source material. As a result, source materialsin both the 16:9 format and the 4:3 format are made available to theproduction paths 110A, 110B.

Cropping of the 16:9 video material into the 4:3 format takes intoconsideration the parameters of the 4:3 format, as well as theparameters of the show being produced. Accordingly, compositing thevideo materials to form the 4:3 output 112A and the 16:9 output 112B isenhanced, thereby increasing the quality of these output signals 112.

For example, consider the case where the script calls for a video signalto appear above and to the right of the anchor's shoulders. By knowingthis ahead of time (during pre-production), the 16:9 original videosignal can be cropped into the 4:3 format so that all the pertinentinformation will be conveyed in both the 16:9 output 112B, as well asthe 4:3 output 112A.

User Interface

As clear from the description above, the user interface 106 enablesusers 104 to create scripts that, when executed by the control system108, simultaneously generates the 4:3 output 112A and the 16:9 output112B. Such dual format operation of the invention is transparent to theuser 104. In other words, the user 104 does not need to explicitlydesign the script to achieve such dual format broadcasts. Instead, theinvention utilizes transition macros that are coded for both formats, asdescribed above.

The invention also supports “hot keys” that are coded for both formats.For example, the invention supports Late Breaking News keys, which whenactivated by the user 104 inserts into the script commands toaccommodate a late breaking news segment. Hot keys are described ingreater detail in U.S. Pat. No. 6,452,612, referenced above. Accordingto the invention, such hot keys are associated with transition macroshaving instructions for both the 4:3 format and the 16:9 format.

Automated Real-Time Execution of Live Inserts of Repurposed StoredContent Distribution

A method, system, and computer program product are provided forsegmenting and marking digital video productions, such that all orsegments of the production can be retrieved for a repurposeddistribution over traditional mediums or computer networks, such as theInternet. As described in greater detail below, the present inventionincludes methodologies for removing or editing keyers, charactergenerators, etc. The present invention enables one to change the orderof the repurposed distribution or add segments from another production.The present invention also enables the insertion of advertisements andother information into the repurposed video stream.

Overview

Cable 24 hour news channels have found a niche for consumers looking forreal time news information at the local/regional level. The 24-hour newschannel model serves the community looking for updated news around theclock without having to wait for specific times as is typical oftraditional broadcast local news. Traditional local broadcasters deliverlive newscasts daily in the morning (5:00 AM-7:00 AM), afternoon (11:00AM-1:00 PM), evenings (4:00 PM 6:00 PM) and late evening hours (10:00PM-12:00 PM). The demand for local 24-hour news channels can beattributed to the different working hours and shifts associated withtoday's work environments along with the sense of immediacy that hasbeen cultivated by the Internet.

In addition, in the not so distant future, local broadcasters will beable to participate in this market trend through the appropriate use ofallocated digital bandwidth. The local broadcaster will be able todivide their digital bandwidth into multiple standard definitiontelevision (SDTV) channels that allows them to develop new applications.Local broadcasters in mid to large markets will take advantage of thesechannel opportunities to provide for new revenue applications such as24-hour local news, local sports, local shopping and local educationprogramming.

Two methods of deployment exist. One is to provide 24-hour “live”programming around the clock. Second, provide “live” programming whenthe “facts” change. In other words, a cable or local broadcaster canproduce live content in the first ½ hour followed by a “repurposed” ½hour on the back with live inserts for stories or events that requirereal time updates such as traffic and weather reports along withbreaking news stories of events occurring in real time. Today, this ismanaged manually since the intelligence does not exist to automate thisprocess. The manual process does not allow for true automated liveinserts without many resources to manage the process.

Therefore a need exists to automate this process so that digital SDTV24-hour programming channels can cost effectively produce content whilethe market develops. This will require a design that integrates theautomated production environment with storage equipment intelligentlyincluding the ability to edit stories in real time during the productionprocess while automatically maintaining a database and daily schedule atboth the micro (story level) and macro (show level) resolution.

Detailed Description

FIG. 4 is a production system 402 according to an embodiment of theinvention. The production system 402 includes a user interface 406 forenabling interaction with users 404. The production system 402 alsoincludes a control system 408 which is similar to the control system 108described above. The control system 408 controls the production system402 to achieve the functionality described herein.

The production system 402 includes a number of sources 410, including astory archive 412 and other production devices 414. The story archive412 is a database having stored therein previously produced stories(although a “story” stored in this database may be any portion of ashow). The production devices 414 are any known device for producing ashow, such as a video switcher, camera, audio control, still store, tapemachine, etc.

The production system 402 further includes one or more switchers 416,which receives sources 410 and is controlled by the control system 408.The switchers 416 generate an output 418, which in an embodimentrepresents a live or as-live show.

The production system 402 may be implemented using a production systemas described in U.S. Pat. No. 6,452,612, referenced above.

FIG. 2 is a flowchart 202 representing the operation of the productionsystem 402 according to an embodiment of the invention.

In step 204, the user 404 interacts with the user interface 406 togenerate a script for the show that is to be produced. Such operation isdescribed in detail in U.S. Pat. No. 6,452,612, referenced above.

In step 206, the production system 402 produces the show according tothe script generated in step 204. Such operation is described in detailin U.S. Pat. No. 6,452,612, referenced above.

In step 208, the production system 402 segments the show (produced instep 206) according to some criteria. In an embodiment, the show issegmented according to content. Specifically, in an embodiment, the showis segmented according to story. Accordingly, in step 208, theproduction system 402 divides the show into its component stories.

In step 210, these stories are stored in the story archive 412, andindexed (or otherwise marked or tagged) for later retrieval.

In an embodiment, the production system 402 performs step 208 byrecording the beginning and end of each story in the show, and/or theduration of each story. This information is stored, for example in thestory archive 412, along with the show. Also stored is the story type orcategory of each story. Subsequently, the production system 402 canuniquely access any story in the show using this information (metadata).

It is noted that a “story” can be any portion of the show.

Further description regarding the segmentation of a show is provided in“Method, System and Computer Program Product for Producing andDistributing Enhanced Media Downstreams,” Ser. No. 09/836,239, filedApr. 18, 2001, referenced above.

In step 212, the production system 402 generates additional programming,such as a new live or as-live show, using a combination of live insertsand archived material from the story archive 412. The live inserts aregenerated using the production devices 414. The material from the storyarchive 412 may be modified, if necessary, using the production devices414. In some cases, the additional programming is comprised of onlymaterial from the story archive 412, although such materials may bemodified to some extent. The operation of step 212 is shown in greaterdetail in FIG. 3, which shall now be considered.

In step 302, the user 404 interacts with the production system 402 viathe user interface 406 to create or modify a listing for a Current Show.The Current Show is a new show being designed for production using liveinserts and material from the story archive 412. The listing lists thecomponents of the Current Show. For example, FIG. 5 shows a Current ShowListing 506 having 6 components/segments/stories: a traffic report 520A,a weather report 520B, sports spotlight 520C, a live 10:15 AM insert518B, a bridge collapse story 520E, and an entertainment segment 520F.Note that the sports spotlight 520C and the bridge collapse story 520Eare from the story archive 412 (shown in the archived video window 508of FIG. 5). The 10:15 AM insert 518B is a live insert (see the livesegments window 504).

FIG. 5 illustrates an example user interface 502 (provided by the userinterface 406 shown in FIG. 4) for enabling the user 404 to create andmodify the Current Show Listing 506. The user 404 can drag and drop livesegments from the live segment window 504, and/or archived stories fromthe archived video window 508. Within the current show window 506, theuser 404 can use well known computer pointing techniques to arrange andorder the components of the Current Show. Other user interfaces couldalternatively be used, such as those described in U.S. Pat. No.6,452,612 and/or pending U.S. application Ser. No. 09/836,239,referenced above.

In step 304, the production system 404 maps the Current Show Listing 506to a production system script that comprises transition macros. Scriptsand transition macros are described in detail in U.S. Pat. No.6,452,612, as well as other patents and patent applications referencedabove.

In step 306, the production system 404 produces the Current Showaccording to the Current Show Listing 506 and/or the script (from step304). Step 306 includes steps 308, 310, and 312, which shall now bedescribed.

In step 308, the production system 404 retrieves and modifies, asnecessary, archived materials from the story archive 412, in accordancewith the Current Show Listing 506. Such retrieved materials are insertedinto the output 418 via the switcher 416.

Step 308 involves automatic “downstream” keyer changes for “as live”replay of the retrieved materials (as necessary). For example, supposedthe retrieved materials include a “bug” (for example, a time andtemperature overlay on top of the video). In this example, theproduction system 404 would cause the keyer (one of the productiondevices 414) to either eliminate the bug, or update the bug with thecurrent time and temperature.

In an embodiment, step 308 is achieved by modifying the retrievedmaterials, in the manner just described. In an alternative embodiment,this is achieved by not recording the bug in the materials when thematerials were originally produced (in step 206). In this embodiment,the bug is inserted into the output 418 in real-time.

In step 310, the production system 404 generates live segments inaccordance with the Current Show Listing 506. Such live segments areinserted into the output 418 via the switcher 416.

Note that the user interface 502 includes a Time Over/Under for Current½ Hour timer 514, which indicates the amount of time that the show isover/under given the stories already aired and the stories that are yetto be aired, and a Time Left for Current ½ Hour timer 516, whichindicates the time remaining in the 30 minute show (these counters 514,516 are based on a 30 minute show). These counters 514, 516 are used bythe director 404 to ensure that the show fits into the allotted time(i.e., 30 minutes in the example of FIG. 5). The director 404 cancontrol the length of any live segments to ensure that the show fitswithin the 30 minute slot. Alternatively, the director 404 can selectother archived materials from the story archive 412 based on duration ofsuch materials to ensure the show fits within the allotted slot.Manipulation of the Current Show Listing 506 in this manner is describedin greater detail in “Method, System and Computer Program Product forProducing and Distributing Enhanced Media Downstreams,” Ser. No.09/836,239, filed Apr. 18, 2001, referenced above (in the context of anapproval application, system, method, and computer program product).

In step 312, the production system 402 inserts advertisements into theoutput stream 418. In an embodiment, the ads are “searched” to importthe right ad with the correct duration, and possibly content. In otherwords, based on the scheduled “break” length, and/or the content ofstories around the break, commercials of corresponding duration will beaccessed and inserted into the output stream 418.

As the Current Show is produced, some segments may run longer or shorterthan originally expected. The production system 402 keeps track of theoverage or underage, and may adjust the duration of commercial breaks tocompensate for such overage/underage. If the duration(s) of thecommercial breaks change, then the production system 402 selects andinserts into the output stream 418 combination(s) of commercials thatfit the duration of the breaks. Other aspects involving the selection ofcommercials are described in “Advertisement Management Method, System,and Computer Program Product,” Ser. No. 10/247,783, filed Sep. 20, 2002,referenced above.

Media Manager

FIG. 6 is a block diagram showing a media manager 602 and a server 604according to an embodiment of the invention. The media manager 602 andserver 604 are optionally part of the production systems 102, 402 shownin FIGS. 1 and 4, for example.

The media manager 602 manages the selection, play out status, play outchannel assignment of both video clips and graphic files from the server604.

The media manager 602/server 604 combination has a number of features:

Media Types: The combination combines the management of a video server,still store, and character generator under one software interface. Themedia may consist of video and key. The key can be linked with the videofor play out.

Integrated server. In an embodiment, the server 604 is an integratedserver that is capable of internally keying media, with key signals, andoutputting the composite media out a single channel.

Clip & Graphic Selection: The Media Manager 602 interfaces with userinterfaces 106, 406 to allow the user 104, 404 to brow a low-resolutionimage of video clips and graphic files available in the server 604.These clip or graphic Id's can then be assigned to a particular storywithin the rundown. Non-integrated servers may only be able to export alist of clip or graphic id's available for selection.

Play out Status: The Media Manager 602 updates the status of a clipassigned to a particular story. When a clip is assigned to a particularstory within the rundown, the Media Manager 602 tracks the air readinessof that particular clip. If a predefined graphic Id were entered intothe rundown that does not exist, Media Manager 602 would notify therundown that the graphic requested is not air ready.

When the production system 102, 402 monitors a rundown, a list of clipsand graphics is generated under each story slug. If a clip or graphic isnot air ready, the text is colored red. The status of the clip orgraphic is automatically updated, until the rundown is unmonitored. Whena list item that is colored red, becomes air ready, the text is changedto black.

Auto Assign Play out Channels: When a particular story is previewed forair, Media Manager 602 automatically assigns the clips and graphics onan available play out channel (video & key) from a pool of channels.There are two parts to the channel assignment. Part one loads the mediato the auto-assigned channel. Part two routes the auto-assigned channelto the proper background or key channel. (Channels on-air and requestedchannels for preview cannot exceed the total number of channels for thesystem.)

The media manager 602 and server 604 shall now be described in greaterdetail.

As noted above, in an embodiment, the server 604 is an integratedserver. The media manager 602 communicates and interacts with the server604 in the server 604's native language, such that the media manager 602is capable of accessing additional functionality of the server 604.

The media manager 602 manages the play-out of server clips and stilldevices. The media manager 602 controls what channels (ports) 606 of theserver 604 these play out, and will ascertain if the clip exists or doesnot exist. When a particular clip on the script comes up to be output,the media manager 606 automatically assigns the channel that it will beplayed out on, from the pool of channels that exist. This process iscalled auto-channeling.

For example, suppose the production system 102, 402 is processing a“load media” command from a transition macro. According to theinvention, the media manager 602 automatically finds the next unusedport 606 of the server 604, and uses that port 606 to output the mediafrom the server 604. In other words, the port 606 of the server 604 neednot be hard-coded into the “load media” command.

There are various benefits of auto-channeling. First, if the server portmust be hard-coded into transition macros, then the library oftransition macros becomes very large (for example, there must be atransition macro for each function/port combination). Withauto-channeling, only a single transition macro for a given function isneeded, since the channel 606 of the server 604 that is going to be usedis automatically determined by the media manager 602 when the command isexecuted. Second, auto-channeling greatly simplifies user operation,since the user need not be concerned with specifying the server port touse. Instead, the user can focus on selecting and ordering thetransition macros in order to produce the desired show.

It is noted that the media manager 602 can operate with non-integrated,commercially available servers. In this case, it is necessary to producea configuration file or otherwise inform the media manager 602 of thenumber and configuration of the server's ports/channels.

CONCLUSION

While various embodiments of the present invention have been describedabove, it should be understood that they have been presented by way ofexample only, and not limitation. It will be apparent to persons skilledin the relevant art that various changes in form and detail can be madetherein without departing from the spirit and scope of the invention.Thus, the breadth and scope of the present invention should not belimited by any of the above-described exemplary embodiments, but shouldbe defined only in accordance with the following claims and theirequivalents.

What is claimed is:
 1. A production system for managing real-time mediaproduction and distribution, the system comprising: a video serverconfigured to store a video clip; a control system configured to executea script to produce a show that includes the video clip; a userinterface configured to generate the script to comprise a plurality oftransition macros configured to control respective production elementsin a plurality of production paths to generate the show with the videoclip in first and second aspect ratios to form respective first andsecond media content segments; a media content format converterconfigured to automatically resize the video clip to convert the videoclip from the first aspect ratio to the second aspect ratio that isdifferent than the first aspect ratio to form the first and second mediacontent segments, respectively; a media manager configured toautomatically select one of a plurality of playout channels of aproduction server to play out the show as the first and second mediacontent segments based on an auto-channeling transition macro in thescript; a media effect controller configured to independently adjust afirst transition effect of the first media content segment based on thefirst aspect ratio and a second transition effect of the second mediacontent based on the second aspect ratio, with the first and secondtransition effects configured by respective effect transition macrosincluded in the script; wherein the selected playout channel is selectedbased on execution of a respective command of the auto-channelingtransition macro in the script; wherein the media manager is configuredto track air readiness of the video clip selected for playout and toprovide a notification on the user interface when the video clip is notair ready; wherein the user interface comprises a graphic configured toindicate the air readiness of the video clip and to modify the graphicwhen the video clip becomes air ready; wherein the plurality oftransition macros include a keying transition macro for executing akeying function in the video clip for producing the show formatted inthe first and second aspect ratios, such that a user does not need toexecute the keying function separately for the show generated in eachrespective aspect ratio; wherein the first media content segmentformatted in the first aspect ratio comprises a 4:3 format and thesecond media content segment formatted in the second aspect ratiocomprises a 16:9 format; and wherein each of the first and secondtransition effects comprises at least one of a cut transition, a fadetransition, and a wipe transition based on the first and second aspectratios, respectively.
 2. The production system according to claim 1,wherein the media manager is configured to automatically select firstand second playout channels from the production server for transmittingthe show including the first and second media content segments formattedin the first and second aspect ratios over first and second distributionchannels, respectively.
 3. The production system according to claim 2,wherein the media manager is configured to simulcast the show includingthe first and second media content segments formatted in the first andsecond aspect ratios over the first and the second distributionchannels, respectively.
 4. The production system according to claim 3,wherein the media manager is configured to align outputs of the showincluding the first and second media content segments formatted in thefirst and second aspect ratios for production when simulcast over thefirst and the second distribution channels, respectively.
 5. Theproduction system according to claim 1, wherein the media manager isfurther configured to automatically select and assign the one playoutchannel to one of a background channel and a key channel to play out theshow with a corresponding background or key, respectively, based on theauto-channeling transition macro in the script.
 6. The production systemaccording to claim 1, wherein the media content format converter isfurther configured to automatically resize the video clip by croppingthe video clip to convert the video clip to the second aspect ratio toform the second media content segment.
 7. A production system formanaging real-time media production and distribution, the systemcomprising: a control system configured to execute a script to produce ashow that includes a video clip; a user interface configured to generatethe script to comprise a plurality of transition macros configured tocontrol respective production elements in a plurality of productionpaths to generate the show with the video clip in first and secondaspect ratios to form respective first and second media contentsegments; a media effect controller configured to independently adjust afirst transition effect of the first media content segment based on thefirst aspect ratio and a second transition effect of the second mediacontent based on the second aspect ratio, with the first and secondtransition effects configured by respective effect transition macrosincluded in the script; a media manager configured to track airreadiness of the video clip selected for playout and to provide anotification on the user interface when the video clip is not air ready;wherein the user interface comprises a graphic configured to indicatethe air readiness of the video clip and to modify the graphic when thevideo clip becomes air ready; and wherein each of the first and secondtransition effects comprises at least one of a cut transition, a fadetransition, and a wipe transition based on the first and second aspectratios, respectively.
 8. The production system according to claim 7,further comprising a media content format converter configured toautomatically resize the video clip to convert the video clip from thefirst aspect ratio to the second aspect ratio that is different than thefirst aspect ratio to form the first and second media content segments,respectively.
 9. The production system according to claim 8, wherein themedia content format converter is further configured to automaticallyresize the video clip by cropping the video clip to convert the videoclip to the second aspect ratio to form the second media contentsegment.
 10. The production system according to claim 7, wherein themedia manager is further configured to automatically select one of aplurality of playout channels of a production server to play out theshow as the first and second media content segments based on anauto-channeling transition macro in the script.
 11. The productionsystem according to claim 10, wherein the selected playout channel isselected based on execution of a respective command of theauto-channeling transition macro in the script.
 12. The productionsystem according to claim 10, wherein the media manager is configured toautomatically select first and second playout channels from theproduction server for transmitting the show including the first andsecond media content segments formatted in the first and second aspectratios over first and second distribution channels, respectively. 13.The production system according to claim 12, wherein the media manageris configured to simulcast the show including the first and second mediacontent segments formatted in the first and second aspect ratios overthe first and the second distribution channels, respectively.
 14. Theproduction system according to claim 13, wherein the media manager isconfigured to align outputs of the show including comprising the firstand second media content segments formatted in the first and secondaspect ratios for production when simulcast over the first and thesecond distribution channels, respectively.
 15. The production systemaccording to claim 7, wherein the plurality of transition macros includea keying transition macro for executing a keying function in the videoclip for producing the show formatted in the first and second aspectratios, such that a user does not need to execute the keying functionseparately for the show generated in each respective aspect ratio. 16.The production system according to claim 7, wherein the first mediacontent segment formatted in the first aspect ratio comprises a 4:3format and the second media content segment formatted in the secondaspect ratio comprises a 16:9 format.
 17. The production systemaccording to claim 10, wherein the media manager is further configuredto automatically select and assign the one playout channel to one of abackground channel and a key channel to play out the show with acorresponding background or key, respectively, based on theauto-channeling transition macro in the script.
 18. A production systemfor managing real-time media production and distribution, the systemcomprising: a control system configured to execute a script to produce ashow that includes a video clip; a user interface configured to generatethe script to comprise a plurality of transition macros configured tocontrol production elements to generate the show with the video clip; amedia effect controller configured to independently control a transitioneffect for the show based on an effect transition macros included inplurality of transition macros of the script; a media manager configuredto track air readiness of the video clip selected for playout and toprovide a notification on the user interface when the video clip is notair ready; and wherein the control system is configured to produce theshow with the executed transition effect when the media manager confirmsthe video clip is air ready.
 19. The production system according toclaim 18, wherein the user interface comprises a graphic configured toindicate the air readiness of the video clip and to modify the graphicwhen the video clip becomes air ready.
 20. The production systemaccording to claim 18, wherein the transition effect comprises at leastone of a cut transition, a fade transition, and a wipe transition. 21.The production system according to claim 18, wherein the plurality oftransition macros are configured to control respective productionelements in a plurality of production paths to generate the show withthe video clip in first and second aspect ratios to form respectivefirst and second media content segments.
 22. The production systemaccording to claim 21, further comprising a media content formatconverter configured to automatically crop the video clip to convert thevideo clip from the first aspect ratio to the second aspect ratio thatis different than the first aspect ratio to form the first and secondmedia content segments, respectively.
 23. The production systemaccording to claim 22, wherein the media content format converter isfurther configured to automatically resize the video clip by croppingthe video clip to convert the video clip to the second aspect ratio toform the second media content segment.
 24. The production systemaccording to claim 21, wherein the plurality of transition macrosinclude a keying transition macro for executing a keying function in thevideo clip for producing the show formatted in the first and secondaspect ratios, such that a user does not need to execute the keyingfunction separately for the show generated in each respective aspectratio.
 25. The production system according to claim 21, wherein thefirst media content segment formatted in the first aspect ratiocomprises a 4:3 format and the second media content segment formatted inthe second aspect ratio comprises a 16:9 format.
 26. The productionsystem according to claim 21, wherein the media manager is furtherconfigured to automatically select one of a plurality of playoutchannels of a production server to play out the show as based on anauto-channeling transition macro in the script.
 27. The productionsystem according to claim 26, wherein the selected playout channel isselected based on execution of a respective command of theauto-channeling transition macro in the script.
 28. The productionsystem according to claim 26, wherein the media manager is configured toautomatically select first and second playout channels from theproduction server for transmitting the show formatted in the first andsecond aspect ratios over first and second distribution channels,respectively.
 29. The production system according to claim 28, whereinthe media manager is configured to simulcast the show formatted in thefirst and second aspect ratios over the first and the seconddistribution channels, respectively.
 30. The production system accordingto claim 29, wherein the media manager is configured to align outputs ofthe show formatted in the first and second aspect ratios for productionwhen simulcast over the first and the second distribution channels,respectively.
 31. The production system according to claim 26, whereinthe media manager is further configured to automatically select andassign the one playout channel to one of a background channel and a keychannel to play out the show with a corresponding background or key,respectively, based on the auto-channeling transition macro in thescript.